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Abstract 


In  the  National  Aeronautics  and  Space  Administration  (NASA)  and  the 

Department  of  Defense  (DoD)  the  Technology  Readiness  Level  (TRL)  scale 
is  a  measure  of  maturity  of  an  individual  technology,  with  a  view  towards 
operational  use  in  a  system  context.  A  comprehensive  set  of  concerns 
becomes  relevant  when  this  metric  is  abstracted  from  an  individual 
technology  to  a  system  context,  which  may  involve  interplay  among 
multiple  technologies  that  are  integrated  through  a  systems  engineering 
process.  This  research  proposes  the  development  of  a  system-focused 
approach  for  managing  system  development  and  making  effective  and 
efficient  decisions  during  a  systems  engineering  process.  This  research  will 
present  a  System  Readiness  Level  (SRL)  index  that  incorporates  both  the 
current  TRL  scale  and  the  concept  of  an  Integration  Readiness  Level  (IRL) 
and  provide  a  method  for  determining  current  and  future  readiness  of  a 
system  to  determine  its  potential  position  in  the  systems  engineering 
process. 
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What's  Missing  in  TRL? 

*  A  complete  representation  of  the  (difficulty  of)  integration 
of  the  subject  technology  or  subsystems  into  an  operational 
system  (Dowling  and  Pardoe,  2005,  Mankins,  2002,  Meystel 
et  al.,  2003,  Smith,  2005,  Valerdi  and  Kohl,  2004), 

*  The  uncertainty  that  may  be  expected  in  moving  through 
the  maturation  of  TRL  (Shishko  et  al.,  2003,  Cundiff,  2003, 
Dowling  and  Pardoe,  2005,  Mankins,  2002,  Smith,  2005, 
Moorehouse,  2001),  and 

*  Comparative  analysis  techniques  for  alternative  TRLs 

(Cundiff,  2003,  Dowling  and  Pardoe,  2005,  Mankins,  2002, 
Smith,  2005,  Valerdi  and  Kohl,  2004). 

“In  order  to  succeed  over  the  longer  term,  additional  methodologies  are  needed,  including  those  which  allow 
the  identification  of  anticipated  uncertainty  in  planned  R&T  programs...”  (Mankins,  2002) 
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Other  Theories 


•  Manufacturing  Readiness  Level  (DoD) 

-  Used  to  assess  the  SE/design  process  and  maturity  of  a  technology's 
associated  manufacturing  processes  to  enable  rapid,  affordable 
transition  to  acquisition  programs. 

•  Integrated  Technology  Analysis  Methodology  (ITAM) 
(Mankins,  2002) 

-  Discipline-neutral,  quantitative  measure  of  the  relative  technological 
challenge  inherent  in  various  candidate/competing  advanced  systems 
concepts. 

•  Systems  Integration  Readiness  Level  (MoD) 

-  System  Readiness  Levels  (SRLs)  were  developed  as  a  tool  for  projects 
to  assess  System  Maturity,  and  to  communicate  this  in  a  consistent 
manner. 
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Operations  &  Support  (4.3.5) 

9 

Production  Development  (4.3.4) 

l~8 

System  Development  & 
Demonstration  (4.3.3) 


Technology  Development  (4.3.2) 


Concept  Refinement  (4.3.1) 


Basic  Technology  Research 


Point  of  Transition  or 
Integration  * 


Phase  and  TRL  scales  on 
parallel  paths  still  do  not 
consider  integration. 


Sauser,  B.J.,  D.  Verma,  J.  Ramirez-Marquez,  and  R.  Gove.  (2006).  “From  TRL  to  SRL:  The  Concept  of  Systems  Readiness  Levels.”  Conference  on  Systems 
Engineering  Research,  April  7-8.  Los  Angles,  CA 
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lA/hy  do  we  need  a  Systems  Readiness 

The  System  L6V6I  (SRL)? 
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Technology 
Readiness 
Level  (TRL) 


Integration 
Readiness 
Level  (IRL) 


Development  of  metrics,  tool,  and  methodologies  for 
determining  a  systems  readiness  level  (SRL)  and 
potential  for  making  efficient  and  effective  life-cycle 
acquisition  and  operational  decisions.  The  SRL  Model 
is  a  function  of  the  individual  Technology  Readiness 
Levels  (TRL)  and  their  subsequent  integration  points 
with  other  technologies,  the  Integration  Readiness 
Level  (IRL). 


SRL  =  f  (TRL,  IRL) 


Value  Proposition: 

•  Currently  TRL  is  only  a  measure  of  an  individual 
technology 

•  There  is  no  method  for  integrating  TRLs 

•  There  is  no  systematic  measure  of  a  systems  readiness 

•  Cost  and  schedule  reduction  in  strategic  technology 
development  planning 

Deliverable:  Integration  of  methodologies  for 
strategic  roadmap  planning  that  illustrate  the 
timely  implementation  of  capability  increments. 


©  2007  Stevens  Institute  of  Technology 


7 


Semantic  Syntactic  Pragmatic 


STEVENS 


Institute  of  Technology  Systems&Enterprises 

Integration  Readiness  Level 

A  systematic  measurement  of  the  interfacing  of  compatible  interactions  for  various  technologies  and  the 
consistent  comparison  of  the  maturity  between  integration  points. 


Integration  -  the  combining  and  coordinating  of  separate  components  into  a  seamless  unit  - 
interfacing  the  compatible  interactions  of  various  technologies  together 


IRL 

Definition 

9 

Integration  is  Mission  Proven  through  successful  mission  operations. 

8 

Actual  integration  completed  and  Mission  Qualified  through  test  and  demonstration,  in  the  system  environment. 

7 

The  integration  of  technologies  has  been  Verified  and  Validated  with  sufficient  detail  to  be  actionable. 

6 

The  integrating  technologies  can  Accept,  Translate,  and  Structure  Information  for  its  intended  application. 

5 

There  is  sufficient  Control  between  technologies  necessary  to  establish,  manage,  and  terminate  the  integration. 

4 

There  is  sufficient  detail  in  the  Quality  and  Assurance  of  the  integration  between  technologies. 

3 

There  is  Compatibility  (i.e.  common  language)  between  technologies  to  orderly  and  efficiently  integrate  and 
interact. 

2 

There  is  some  level  of  specificity  to  characterize  the  Interaction  (i.e.  ability  to  influence)  between  technologies 
through  their  interface. 

1 

An  Interface  between  technologies  has  been  identified  with  sufficient  detail  to  allow  characterization  of  the 
relationship. 

Gove,  R.  (2007)  Development  of  an  Integration  Ontology  for  Systems  Operational  Effectiveness.  M.S.  Thesis.  Stevens  Institute  of  Technology.  Hoboken,  NJ 
Gove,  R.,  B.  Sauser,  J.  Ramirez-Marquez.  (2007).  “Integration  Maturity  Metrics:  Development  of  an  Integration  Readiness  Level.”  Acta  Astronautica  (under 
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Step  1:  Determining  the  TRL  and  IRL 
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Step  2:  Creating  the  TRL  Matrix 
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System  Alpha  -  IRL 

Step  3:  Creating  the  IRL  Matrix 


School  of 

Systems&Enterprises 


r 

Technology 

1 

A 

V 

Technology 

2 

<J 

L. 

I RL  Matrix 


1  RL-l 

irl12 

irl13 

9 

1 

9 

IRL12 

irl2 

irl23 

— 

1 

9 

7 

V  1  rL13 

IRL.23 

1  RL-3  / 

,  9 

7 

9, 

Technology 

3 


IRL2,3  =  7 


TRL3  =  6 


Sauser,  B.,  J.  Ramirez-Marquez,  D.  Henry  and  D.  Dimarzio.  (2007).  “A  System  Maturity  Index  for  the  Systems  Engineering  Life  Cycle.”  International  Journal  of  Industrial  and 
Systems  Engineering.  3(6).  (forthcoming) 


STEVENS 


Institute  of  Technology 


SRL  for  System  Alpha 

Step  4:  Normalizing  the  TRLs  and  IRLs 
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SRL  Calculation  of  System  Alpha 

Step  5:  Calculating  the  SRLx 
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SRL  =  I RL  x  TRL 
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Note:  SRL*  represents  Technology  X  and  its  I  RLs 
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SRL  for  System  Alpha 

Step  6:  Calculating  the  Composite  SRL 
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SRL  Calculator  with  System  Alpha 
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SRL  Calculator 


IMPORTANT 


-  Enter  TRL  and  IRL  values  (I  to  9  scale)  in  the  above 
boxes  only 

-  Leave  BLANKS  for  non-existent  TRLs  and  IRLs 
connecting  them  to  any  other  TRL 

-  Enter  level  9  for  IRLs  that  don't  exist  between  existing 
TRLs 
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System  Life  Cycle  of  System  Alpha 
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2  Years 


SRL  System  Alpha 
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Spiral  Development  Activity 
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Planning 
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Other  Case  Examples 
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SRL  =  0.74 


Mars  Climate  Orbiter  (MCO): 

Robotic  spacecraft  sent  to  orbit 
Mars  and  collect  data  on  Martian 
atmospheric  conditions,  and  act 
as  a  communications  relay  for 
future  missions.  MCO  failed  due 
to  impulse-bit  data  was  assumed 
to  be  produced  by  the  “Small 
Forces”  files  in  Newton-Seconds 
(N-s),  whereas  “Small  Forces” 
actually  output  in  Pound- 
Seconds  (Ibs-s). 


LLLU 


SRL  =  0.67 


ARIANE  5:  Launch  platform  for 
delivering  payloads  into  Earth 
Orbit.  ARIANE  5  failed  when  an 
inertial  Reference  System  failed 
36.7  seconds  after  launch  due  to 
a  software  exception  caused  by 
the  rocket’s  horizontal  velocity, 
which  was  within  thresholds, 
exceeding  the  limit  of  what  the 
onboard-software  could  handle. 


Hubble  Space  Telescope- 
SM-1:  Servicing  Mission 
(SM)  to  Hubble  to  correct 
the  spherical  aberration 
present  on  the  primary 
mirror,  and  provide 
necessary  support 
maintenance.  SM-1  resulted 
in  successful  servicing  of 
Hubble,  a  return  to 
successful  science 
operations,  and  a  safe  return 
of  shuttle  crew. 


SRL  =  0.84 


Hubble  Space  Telescope- 
RSM:  Service  Hubble  and 
other  spacecraft  using  a 
robotic  servicing  craft  thereby 
reducing  cost,  and  the  risk  to 
human  life.  A  problem  arose 
when  the  technology  and 
concepts  for  RSM  were 
unproven  in  space  and  a  RSM 
seemed  not  to  be  feasible  in 
time. 
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System  Readiness  Potential  (SRP) 


Optimization  Example  of  System 
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SRL  Optimization  of  System  Alpha* 


*  This  example  assumes 
TRLs  are  held  constant 
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System  Readiness  Potential  (SRP) 


Table  1 :  Cost  and  Time  Consumption  by  IRL 


Technologies 

1,2 

2,3 

IRL  Level 

Cost 

Time 

Cost 

Time 

i 

$0 

0 

$0 

0 

2 

$123 

80 

$0 

0 

3 

$219 

380 

$0 

0 

4 

$595 

532 

$0 

0 

5 

$700 

621 

$0 

0 

6 

$808 

862 

$0 

0 

7 

$1,003 

997 

$0 

0 

8 

$1,110 

1145 

$400 

165 

9 

$1,452 

1623 

$650 

389 

Available  Resources 

Cost 

$1,400 

Time 

1200 

Table  2:  Optimization  Results 


Objective  Function  (SRL) 

0.7243 

Cost  Constraint 

$1,110 

Time  constraint 

1145 

IRL(  1 ,2)  Constraint 

1 

IRL(2,3)  Constraint 

1 

System  Readiness 
Potential  (SIP) 
based  on  resource 
allocation 


Recommendation: 

Increase  IRL  (1 ,2)  from  its  current  value  to  8 
Increase  IRL  (2,3)  stays  at  current  value  of  7 
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System  Life  Cycle  of  System  Alpha 


System  Readiness  Level  vs.  System  Readiness  Potential 
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